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The pat<ential 'bf research vhich usei^ the data base - 
from the National: ItOngitadihal Study of the High Schoojt Class of 1972 
(HLS) for affecting federal policj is discussed. Currently, jsocial 
, science research is rarel^ used. as d basis for policy decisions. A 
-reason for this is that social scientists profess interest in policy 
issues, yet are naive In understanding hov policy decisions arjs 
forsillated ,aiid in knoying hov) to report reseai^h so that it is 
'^politically relevant, A report prepared by the Band Corporalfion se^s 
"\he NLS data as haviijg potential for four stages of policy* 
forkulation: Jk^) early warning of ^orthcoaing probleis, (2) i^sue 
exploration^ (3) identification of specific px;ttbleBS, and t^) 
evaluation of. the iipacts of. past policy decisions. The author ^ 
/ suggests only tvo stages; the exposition or confirsation of a problei 
or^ need that was previously suspected, and the evaluation of prior 
policy decisions or t^olutions .that have begun to fall into* disrepute. 
Political sophistication and an advocate/adi^ersary stance may be the. 
^ ifesearch^t^ools of the future for social scientists. (6H) 
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Potentials *of the ^fLS Data Basa for Issuer-Oriented Analysed' and 
: — ^ —T- ^J"^ 

and for Influencing Educational Policy. Decisions— ^ ^« 
• ' ^ . . ' ^ \ * ^ 

"^From 'the point of ^conception of the National Longitudinal Study,* and* 
. iir virtually a-11 federal reference thereto over the last six* y?ars,'.^^two 
general ''initiating, purposes have usually been stated^ One. has to do with 
its potential for providing social scientists with a c|ata resource, beyond the 
capability of any one person, department, 'or agency to attain,^ thfltt may serve 
Sresearch interests of those intereste^d in iAp^ct of ^education on humari ' 
de^velopment. The qther has been to provide an .ei^l!rical basis for determining 
or examining critical issues in educational policy at the federal' level • It 
is thi^ latter potential that will be th^' prime focus-, of this paper^ ^ 

Relatively^ short shrift can Ke made of the question as to the, potential 
of ^the data base ^or issue oriented analyses, the data collected are primarily 
fact ai5d event centered, with relatively little' emphasis on psychological 
construjCts; reducing phe data mass by fact<v^ -analytic medns is generally so ^ 
inai?^opriAte W has never been involved except fqr miniscule subsets of 'the 
dat^ The data ask essentially the question: given certain prior experiences 
and events, what is the pattern of subsequent^ experiences* and 'events? The- ' 
*"*focus Is on educational experience, its natural or traditional concomitants,"^ 
• and those achievements and activities in young adult life that serve t>o attest 
the quality of -one/s preparation^for life. Criteria for item selection have 
fiocused on the construc'ts of reliability and ultimate validity , not on the 
"^iS^tal hygiene "constructs that have 'tended to dominate the thinking of' 
psycholog*ists for th6 last three decades J the porsojialitv^ theorist anxious 
'to explore some bold 'new model of human development will find little of ' ^ 
interest, but the mathematical statistician, or, more Importantly with regard 
to our topwtcal concerji, the social* econottiJst and' sociologist, will find much 
gTii^t for their mills. The essentiax design strategy is that of the <^nsus- ^ 
•^by-sampling or piepulation survey, not that of hy|)othesis sp^cfif ication and 
establishment of controls and independent/dependent variable sets. Tlnis, t-he 
fociis oi.the NLS^ is on what happens to a curreAt generatioii of young people of 
various b^si'tt^d'cial characteristics ^nd educational experiences. Tfie obvious 



— ^ ^-A paper prs^sented as part of a symposium at the 1976 annual meeting of 
the American, Psychologi^l Association in Washington, D. C. 

■ * « ✓ - 



Issues, that may be e3Cplore4 become oneV $uch as: who receives financial aid 
- and who does^not, and is this associated .with increased access .fco^ and persistence 
la hlgli^r education; what factors<and conditions s§em to. moderate the' evolution 
-an4 afetainpienfr' of career bbjective^^ what barriers' appear to'^exist to entry into 
productive employment; wkaf - are the consequences of early parenthood? 

The focus of the present pkper will not^be on an inventory and prioritizing 
of such issues.. For the sake of argument if nothing else, It would seem that 
issue-oriented research must begia with the identification of a particular 
issue; then one would specify certain kinds' of* data as relevant to that issue; 
and finally, one would' collect that data and note its implications for 
* refining or' resolving the issue.^ In tiie'present situation, one vould best ' 
ask. what specific issues did the NLS rormulators have in mind, or,' at second 
best^ what issues could be illuininated by the particular data'availatjle? . 
The answer to the first question is probably that the? NLS origin was best 
characterized by an expei;i£nce of housekeeping educational data collection • 
for audit and descriptive p^poses, where the pf^e considerations in item 
prescription are what kinds ors^data are readily available that dan be 
consistently and reliably reported' by a variety of individuals and institutions. 
A ^ood answer to our "second best')\ilternatlve, yhich is yhat issues do the 
data suggest, .lies in either an inventory«of pome fifty or onfe hundipd NLS 

^^udies now- reported or. ,in .progre^, or the formal ^nd deliberate inventory 

' / 2/ ' • . / 

produced under.. contract for^'that pftfpose by Rar^cl.— * * 

The more basic question to be addressed brie'fly in this paper is: ^hat 

potentiar^can research with the NLS 4^ta have fpr affecting 'federal policy ? ^ 

^— - — ~ ^"T^ * 

What can research psychologists or other social scientists using the NLS 

* * - ' 

(oi^^any other similar tl&ta base) do to assure * that policy issues are examimed 
(or that policy issue ramifications qt findings are explicitly stated)? * ^ 
And,, what does thd experience thus far, in thla^and- other federally -supported 
stu^iles, suggest may be critical if there is any^ exploitation of the NLS ^ ' 

,to ^he purpose' of determining policy issues^ or examining a^'d ref ining^ federal . ^ 
educational policy? * ^ , , ' 

As psycli|3logists, most';:of*us start such. an examination hampered by the 
handicaps that are attested by, a rather Remarkable lack of success in the • 

past in influencing policy decisions, or with some' initial ,naiVet^ in 'knowing , > 

' ^ ' ' , " ^ i ^ 

— Carroll, e. J. and, Morrison, P. ,A. - ( nlS: An Agenda foar Policy ReSearcri . 
(Bulletin Rt)1964-HEW) . Rand: Santa Moni\:af, .California^ -June 1976. 



when, why,' aad 'how t^'ve scored* A recent highly relevant study by Caplan, 

Morrison, and Stambaugh^'^ at Michigan's Institute for Social Research asked 

,204 persons holding important positions in the executive branch of the govern- 

ment about their awareness and utilization of sociaL^ scienca^ knovledge in ' 

poli^.y relevant situations* They found that although the* respondents generally 

exhibited a^ very .positive attitude toward the social sciences in general, 

utilization of social' science data was generally restricted^to "in-house 

• IK* ' 

studies the ^g^ncy itself -xionducted (51 percent qf research cited) 6r to 

studies the'^agenc^i. contracted (35 percent of research cited) or that wis 

contracted by ^other federal agencies (6 percent). That leaves percent ^ 

that psychologists, so'ciologists, economists, and other social Iciehtists ^ 

^a't large* and *^T^ettered by federal contract may divide up the prime credit 

foir, \tjhey also concluded 'that only rarely is policy formulatioil determined 

by a "point by point reliance on emj^irically 'grounded data," and that 

"political* implications of. research findings appear to override any other 

t consideration in determining utilization (o£«research in policy fo'rmulation) •"" 

Capla{i and his colleagues offer some evidence and some speculatioa as 
to why more respect for than utilization of research exists. Interest in a. 
government career, as opposed to plans to movd on (perhaps back ^o the 
university), wa^ n^gativel/ related to Utilization, as was an "advocacy 
orientation" or prime focus oh the political .exigencies, an areda where* 
most respondents judged social scientists paive. They conclude — that I doubt 
that the policymakers would disagree — that there are basic differences in 
the perspectives o^spcial .scientists and policyrdakers. We must recognize 
also ^that it is acceptable for policymakers to l|e naive in social science 
res€^rcxK «procQdures; it is not acceptable for social scientists to be naive 
in the policy implications 6f their research, ' ^- ^ 

Th.e federal policymaker, not uniike public college presidents looking 
^or ways to^ build and maintain their institutions with tax dollay^ may look 
(o social scien<^e research onl|^ for evidence ^kat can ^up^rt preconceived 
-solutions to preestablished Ij^sue^ -that have preexisting coteries^ of advocates, 
and adversaries; and this reliance -may occur, if commissioned research i^^ 

. " \ ■■ . .' * . . 

3/ • • ^ - - . 

— Caplan, , Morrison, Andrea, and Stambaugh, ' J. The Use o£ Social 

Science^ Knowledge in Policy Decisioft^ at the National Level , Ann Arbor, Mich, : 

In^itute for Social Research, 1975. 

: * ^ - • • ■ / 
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to 'be Involved, only if Che fijidings cail be Reliably fexpe<;ted to support 

the desired solution. Suc^ an attltuc^-^ Is diametrically opposed to th^ 

bas^ value oi^lentatlon of th6 researcher — or at least, to a value tl^e 

researcher must 'profess (or delude^lmself Into believing) to remain a member 

* - * " ' ' • /• " " 

In good ifitanding of one of thei bettet tribes • ' ' , 

* Thus:, differences between social science researchers on the pne hand, 

and' federal pollcyjnakers on the other (and the political cbnstrlctlons to 

which policymakers* must be iresponslve and which the researcher cannot permit 

to control his findings without violatfng his J§mesonlan Oath) »^y be so large 

that* we should forget about policy Impact of NLS and go back to Qur dwi 

' inventory of ' research priorities of the social science rather thaa the \ 
federal coitanunlty. Before we ab&ndon the prospect, however;- two other 
suppos-itions should be stated. * * ' 

Qne reason for the apparent current state of affairs with us (as with 
othei* similar efforts) Is that while we social scientists profess interest 
in- poliqy issues our actual public is usually other social scientists. We 

"narrow our focus to arenas^ we know and can control-*-our caj.leagues and our 
journal editors. And most of us feel that joining a politician lookipg for 
data to. ^support his objectives, rant;s just above publishing routinely iu'the 
Readers' Digest , We can take on Jensen, but heaven protect -us from Edith * 
Sreen! *We are not only non-reSponsive to political realities, but also we 



arg not sophisticated in how policy decisions are formutat^d nor in identifying 

the kepr char^ters and' InterTrelationships amor^ those in the *geats of power . 

Second — and this may be the most critical and relevant ^upposition — -we 

may be' terribly naive in knowing how to cast oui> research — or report it — ' 

so that it is polic^ relevant. Everyone must accept reseircK as relfevattf 

and reputable, ^so why go any fart;her— why not conduct at|4 -publ^^rfi it (with 

execij^tive summary' of no more than five pages if it' is federally, supported) 

and, feo on to the next grant or contract? ' ' fj^ ^ 

4/ . : : * ' ^ . ^ ^ 

t ,The Rand report— — '^from a group tqat is strong- in 'so-called policy 

studi,*s — prefaces the inventory of policy issue priorities, for study t^hrough 

the NLS data base with t^e statement- that policy-relevant uses of research 

include (a) • the t;ransf oration of diffuse and ill-defined social, objectives ; 

(b) the diagnosis of fa£t.cii:^s in the a^ttainment of objectives, and (c) the 

identification, of fa^islble courses of putlic action and the evalutftipn of 



4/ . . * 

— Carroll and Morf l3on#'op, cit , 



probable qws^quences of these alternatives. They further see NLS/data as * ^ 
hmfing potential for four postulated stages of policy f onnulation-4(a) -the 
early warning stage, where some phenomenon or ^chan^e signals forthcoming 
problems on which the government may need tp act; (b) the issue exploration 
stage, v^ere the exi^tance of the problem* is, recognized but cor^ction* 
strategies are uncertain; (c)^ the problem identif ication '^tage, where issues 
are translated into specific problems amenable ^o research; and (d) the 
evaluation stage, where impacts of policy or particular oper^ional applications 
are assessed. These tormul^tfions, I suggest, are more obvibusly thofee the social 
scientist wbuld uge to point <jut the applicability of^eBe^rch to ptaljxy, thaa 
th^ are what the policy nmker- would use. He has to stress relevancy, doesri^t ' 
he? ^ 

' • \ v^^, 

. * I should likp to offer" a simpler formulation that, as a social scientist, \ 
I can, justify on two possible bases,, The^first is ^Aat I believe this simpler 
formulation is a rather clear and obvious .concliisiorv from a historical 
review of what.ge.ts identified as a federal policy issue; tl^second that 
having been unsuccessful (to my knowledge) in three decades of contract research 
in affecting any policy decisions, while believing in guch f ojmulatiofis (or 
rationalizations) as the Raiid report- provides, I must regress to a more 
simplist;ic and primitive explanation. 

' As a working hypothes-i.ai, I should l%ke to suggest that policy issues 
are neither conceived nor 'born out of our research-attested successes dn - 
educational practice, but from i more pervasive suspicion or ^scpvery' 
that some grievous problem or inequity affecting some or all meinberg of our 
soc^et)r exist. This may*meah that our research .h^s an easier- utility for * . 
policy application when it exposes (or mare likely, confirms^ the existance 
of a problem or need. Second, but less likely, there may be policy and issue 
SpplicatiOYi when research can examine, in an evaluation context, some prior 



policy driven solutions^^t are beginning to fall into ^isrepHite but retain ' 
some powerful* advocates. • * . / . . < 

Another notion that 'may be. useful to consider because it may be central 
and yet but dimly perceived* by psychologists now that thelre are so many 
of 'us: that is", federal policy In education is operationalized primarily by 
investment -of large amounts of mooey; 'in some cases where two sub-populatlLons 
are differentially affected by prior investment, federal policy may be " ^ 
expressed by the l^w. It i^ the former. more frequent interest where we 
may more lilcely be effective ,(thOugh some of the more bold s^moiig.us are 
interacting with, the law); but, we need to be aware that while we are i * /' 



agitating aboiit such matters as the distinction between association, or 

relationship vfe. causality; * the policymaker is concerned p^rha'jp^s with 

investing an^ certainly with spending millioas oif -billion^ of dollars 

'on' a caua^l fiunch. The advocates and ^^4vfrsarie^ out in the general public 

wli^re most of us reside are interested in getting money. The supposition, 

that policy is actualized -through investment that will tjalce place with us 

or without us — or with good social scientists or poor ones — may mean 

we have to accept a resp^R^ibili^' beyond our usual adherenq^a to good 

scientific practice. . i 

All of thi§ has^ if applicable, a major consequence for the success£uf 

exploitation of, the NLS data base 'to, issue eJLaboration 'and impact on policy 

formulation. That is: to the extent social problems or inequities can be 

exposed by the data, and. the degree to which the topical areas are ^already 

a part of ' the CAirrent educational acts and amendmgits, we may be succe&sf'ul. 

Also: we may.be successful to the extent that federal dollars are ready 

for l^nve^tment in something in which we can believe,- or when a particular 

^ ^ * - 

investment has attracted powerful adversaries. I assume for these and other 

rea3ons related to the structure and content of the data base tha^the NLS 

data will not prove particularly useful for testing impact o^ federal 

pelicy initiated soluticji^s, where rresearch, if it is to prpvide any data of 

direct relevance, must be designed with the problem in mind. For example: 

we csin identify among our 23,000 individuals^ those who participated in the 

federally supported intervention^ programs of Upward Bound or T^flent Sevch 

and those of similar SE6, race, and ability who did not; we dan't testr 

impact by later performance and persistance because «ven with^ov^rsampling 

the eligible population we have less than 200 participants, whose behavior 

other experimental designs have^ shown is moderated by sex, race, SES, and • 

receiving institution. * 

* • V » 

The- ISR survey suggested that research will more lifeely be 'utilized 

in federal policy formulation if the federal agpncy involved conducts the' 

research in-house or through its own contracts. What are* the implications 

for HCES? The enabling legislation^'^ under which the NLS custodian, tfie^ 

National Center for Edugation Statistics, currently operates specifies 



^ The Educational Amendments of 1*974. 
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thafNjJBS shall :V 



1)4 ^ Collect, and, from time to^time, report. fu 11/and complete 9tati$tics 
on the condition, of education in the United States.;! * ' 1 



2) ' •Conduct and publish reports Jby\ s/ecia-lized ana:l^^es of " the meaning 

an4- significance of such sta,tis£ics; 

' t * • *' * 

3) Assist state and local educational agencies in improving' and automating 

their statistical and ^lata^ collection activities; and 



/ 4) Review, and report on ^ducatioaal activities in foreign countries. 

In discussing the enabling, Ifegislation, the f irst ^Condition of Edu^at 

" 6/ ' ' * 

report—, explicitly states: ' 



ion 



A number of one-time studies and surveys to meeC ^immediate cieeds * 
for information to support policy determination are 'requfred, *as ^ 
x-^ell as continuing' activiude's such as the Consortium of Jederal 
Agencies. • >^ ' . ' — ^ - 

'NCES plays an important facilitating role in th^ development of 
• educationat" policy. It provides information for planning, 
program d/&velopment , and administration for Federal, State, 
local, a/d institutional decisioiyakers. It also provides 
educational data to the general public and to^ researchers tand 
industry,. As the primary source of statistical data for % 
Federal policymakers, NCES must- provide accurate statistical 
information accessible and useful to. tliose who need it. 

f ^ • 

It may be, of course, that KCES wilttbe successful in "facilitating the 

development of educational policy" ^(1) to the extent it may commit itself to, 

in-house research, leaving the out-of-hrfuse social scientists to their own 

devices, and (2) to the extent it may attract a staff — even a constantly 

trapsienD dne — of reputable social scientists Vho can spend time designing' 

studies ^nd analyzing> data, and who can survive wit^|^ dignit>^in the political 

context. Even here, I suspect^ the key to policy relevance' and impact will 

iiet in the degree tb which the data base eX^ses problems or inequities of 

^ the educationaJl^ly treatable human condition, ^and where there are already 

pres^res building for federal financial Investment for a particular 

purpose. I 

But as social stientists we cannot^ -ev^n with a unfettered s,ix percent-^' 

pieoe of the^ policy action, leave NLS and policy relevant research to that as 

♦ 

other agencies, a^one. What do^n do? 13ic advent of •the computer placed 

— , National Center for Education ^Statistics. The Condition of Education . 
Washihgt-on, D.C.: U.S. Government Printing Office, 1975. p. 
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May be that only six^petcenf ofx^r work" support *perconceived 'issues, 

1/9 



Btiariy of u"S\in the poSition>cf having to* learn liew tool sKills , to keep up. 
13ie_ cur ren^^ federal investment in research-, -and the problems NCES ma^f- ^till 
• have if all it can do in its politic^al climate is to af fim^ recognized 
-^^^^|flyit*tes -rather ^an to "discover new opes, or tq; contrieve to collect 
' S'statistics rather than to do research, liiay mean that the more e:{act . 

knowledge of how policy is .formulated b'ecomes a tool •and signals a competency 
that psychologists must acquire. We may also need to modify some of the 
very basic underlying assufltptions that serve as th^ research psychologist's 
manifesto. Which takes us back to the que-stion: caii we adopt Wh advocate/, 
;adversary stance? ' , . . 

' Over decade ago, Harold Pepinsky speculated that even in^the social 
scientist approaches any research with a bias, aad rather than 'delude 
hin^elf that Kis methods protect him from letting that bias inflst this ^ . 
conclusion he should state his bia^ at the outset, so that he and his 
colleagues would nj>t be misled by. the degree to^which he utilized^ such 
niceties as^ control groups, before/after meastjpres, etc., that can be 
affected in subtil ways by the bias. Perhaps we are not at th^ odds we 
6ave' imagined with the policymaker who dwells in thq^advocate/adversaty 
system. Can we live with ourselves and our colleagues if we take up a « 
positibn in step, with current politTca^issues, and like counsel for the 
plantiff, attempt to build a case so sufficient that any other researches 
(counsel for the defehdent) cannot refute it? Our bi£^es as researchers ^s to 
ufan's persistent problems' and as to the proper solutions gf those problems 
* come from the experience of social ^scientists, and our ex^rience. Now all 
we have to worry- at)out Is how much longer with this new attitude experience 
will be an adequate guide . ' 
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